Studying C-tools: Automated Grading for Online Concept Maps
نویسندگان
چکیده
The C-TOOLS research group has developed and released a new assessment tool, the Concept Connector, consisting of a web-based, concept mapping Java applet with automatic scoring. The Concept Connector was designed to enable students in large introductory science classes at the university level to visualize their thinking online and receive immediate formative feedback. The Concept Connector’s flexible scoring system, based on tested grading schemes as well as instructor input, has enabled automatic and immediate online scoring of concept map homework. Criterion concept maps developed by instructors in the C-TOOLS project contain numerous expert-generated or “correct” propositions connecting two concept words together with a linking phrase. In this study a range of holistic algorithms as well as WordNet®, an electronic lexical database and thesaurus, were used to test existing and potential automated methods of scoring to supplement the answers provided by instructors. For this study 1298 student-created concept maps (with 35404 propositions) were evaluated by different “holistic” methods of automatic grading, and in particular, WordNet’s computer-generated propositions were tested for validity.
منابع مشابه
C-tools Automated Grading for Online Concept Maps Works Well with a Little Help from “wordnet”
Criterion concept maps developed by instructors in the C-TOOLS project contain numerous expert-generated or “correct” propositions manually created by expert users connecting two object or subject phrases together with a linking phrase. WordNet, an electronic lexical database, was then used to construct additional proposition derivatives by supplying different linking phrases in place of those ...
متن کاملHow We Teach Model-based reasoning: using visual tools to reveal student learning
Luckie D, Harrison SH, Ebert-May D. Model-based reasoning: using visual tools to reveal student learning. Adv Physiol Educ 35: 59–67, 2011; doi:10.1152/advan.00016.2010.—Using visual models is common in science and should become more common in classrooms. Our research group has developed and completed studies on the use of a visual modeling tool, the Concept Connector. This modeling tool consis...
متن کاملModel-based reasoning: using visual tools to reveal student learning.
Using visual models is common in science and should become more common in classrooms. Our research group has developed and completed studies on the use of a visual modeling tool, the Concept Connector. This modeling tool consists of an online concept mapping Java applet that has automatic scoring functions we refer to as Robograder. The Concept Connector enables students in large introductory s...
متن کاملopenHPI's Coding Tool Family: CodeOcean, CodeHarbor, CodePilot
The Hasso Plattner Institute successfully runs a self-developed Massive Open Online Course (MOOC) platform—openHPI—since 2012. MOOCs, even more than classic classroom situations, depend on automated solutions to assess programming exercises. Manual evaluation is not an option due to the massive amount of users that participate in these courses. The paper at hand maps the landscape of tools that...
متن کاملSoftware verification and graph similarity for automated evaluation of students' assignments
In this paper we promote introducing software verification and control flow graph similarity measurement in automated evaluation of students’ programs. We present a new grading framework that merges results obtained by combination of these two approaches with results obtained by automated testing, leading to improved quality and precision of automated grading. These two approaches are also usef...
متن کامل